LARGE DEVIATIONS OF EMPIRICAL MEASURES UNDER 
SYMMETRIC INTERACTION 
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Abstract. We prove the large deviation principle for the joint empirical mea- 
sure of pairs of random variables which are coupled by a "totally symmetric" 
interaction. The rate function is given by an explicit bilinear expression, which 
is finite only on product measures and hence is non-convex. 



1. Introduction 

1.1. Large deviations of empirical measures have been widely studied in the liter- 
ature since the celebrated Sanov's theorem, which gives the large deviations prin- 
ciple in the scale of n of the empirical measures of i. i. d. random variables with 
the relative entropy H(p\v) = flog^dfi as the rate function. Another entropy, 
Voiculescu's non-commutative entropy = jj\og\x — y\fi{dx)fi(dy), arises in 
the study of fluctuations of eigenvalues of random matrices, see Hiai & Petz^ 
and the references therein. Chan 141 interprets empirical measures of eigenvalues of 
random matrices as a system of interacting diffusions with singular interactions. 

1.2. In this paper we study empirical measures which can be thought of as a 
decoupled version of the empirical measures generated by random matrices. We 
are interested in empirical measures on R 2 generated by pairs of random variables 
that are tied together by a totally symmetric, and hence non-local, interaction, 
see formula Q for the (unnormalized) joint density. Under certain assumptions, 
we prove that the large deviation principle in the scale n 2 holds for the joint em- 
pirical measures, and the rate function is non-convex. As a corollary, we derive 
a large deviations principle for the univariate average empirical measures with a 
rate function that superficially resembles the rate function of random matrices, see 
Corollary^ an interesting feature here is the emergence of concave rate functions, 
see Remark (Eigenvalues of random matrices are exchangeable and the large 
deviation rate function for their empirical measures is convex; infinite exchange- 
able sequences often lead to non-convex rate functions, see Dinwoodie & Zabell 171 
and [Ref.El Example 3].) 

1.3. Let g : R 2 — > R be a continuous function which satisfies the following condi- 
tions. 

Assumption 1. g(x,y) > for all x,y £ R. 
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Assumption 2. For every < a < 1, M a := jjg a (x,y)dxdy < oo. 

Assumption 3. g(x,y) is bounded, g(x,y) < e c . 

In the following statements we use the convention that — logO = oo. 

Assumption 4. The function k(x,y) := — \ogg(x,y) has compact level sets: for 
every a > the set {(x, y) : g(x, y) > e~ a } C M. 2 is compact. 

The purpose of the next assumption is to allow singular interactions, where 
g(x, x) — 0; this assumption is automatically satisfied with (3 = if g(x, y) > for 
all x, y. 

Assumption 5. There is a (3 > such that (x,y) i— ► /31og|x — y\ — logg(x,y) 
extends from {{x,y) : x ^ y} to the continuous function on R 2 . 

Examples of functions that satisfy these assumptions are: the Gaussian kernel 

g(x,y) = e-* 2 -y 2 + 2e *v 

for 16*1 < 1, see the proof of Proposition and a singular kernel 

g(x,y) = \x-yfe~ x2 - y2 

for p > 0, see the proof of Proposition [21 
Define 

n 

(1) f(x 1 ,...,x n ,yt,...,y n )= Y[ g(xi,yj). 

Clearly, / depends on n; we will suppress this dependence in our notation and we 
will further write /(x, y) as a convenient shorthand for f(x\, . . . , x n , y\, . . . , y n ). 
Assumptions n El and|3]imply that / is integrable. Indeed, since g{x,y) < e c , 



z n / f(xi,... 1 x n ,yi,-.-,yn)dxi...dx n dyi...dy n 

< / TT fsfa. yi) eCin ~ 1] ) dx i--- dx nd Vl . . . dy n = e^-^M? < oo. 

We are interested in joint empirical measures 

1 ™ 

(2) An = ^ ^4,3/3-1 

considered as random variables with values in the Polish space of probability mea- 
sures V(M. 2 ) (equipped with the topology of weak convergence), with the distribu- 
tion induced on ^(IR 2 ) by the probability measure Pr = Pr„ 6 "P(R 2n ) defined by 

(3) Pr(dx,rfy) := -i-/(x,y) dxdy. 

Theorem 1. If g(x,y) satisfies Assumptions^ [3 and0 then the joint 
empirical measures {/in} satisfy the large deviation principle in the scale n 2 with 
the rate function I : P(R 2 ) — > [0, oo] given by 

JJ k(x, y)vi(dx)v2(dy) — Io if [i — v\® v-i is a product 

measure and k is fi-integrable; 



(4) = < 



othe 
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where k(x,y) = - log g(x,y) and I = w£ x , y gK.k(z,y). 

Definition 1 ( [Rcf. 2 Chapter 3]). We say that k : M 2 — ► K is a negative definite 
kernel if k(x,y) = k(y,x) and 

(5) 2J k{xi,Xj)ciCj < 

for all Xi,Ci el such that c i = 0- 

Condition (J5J is satisfied for k(x,y) — V(x) + W(y) — n(x,y), where n{x,y) is 
positive-definite . 

Consider the average empirical measures 



1 ™ 



i=l 

Corollary 1. Suppose that the assumptions of Theorem^hold true, and in addition 
k(x,y) is continuous and negative-definite. Then the average empirical measures 
{<r„} satisfy the large deviation principle in the scale n 2 with the rate function 

1(f) = J J k(x, y)v(dx)v(dy) - I , 

and Iq = inf^ k(x, x). 

Proof. This follows from the contraction principle. The mapping i— > 

i J n(-,dy) + i J" /i(dx, •) is continuous in the weak topology. The rate function 
is l{u) = rnf{I(fi ® v 2 ) : v — \v\ + \v 2 }- 

Write K(fi) = JJ k(x,y)n(dx,dy). If v = \v x + \v 2 then [Ref . EH Theorem 3] 
implies that K(i/i ® v 2 ) > K(v ® 1/). Thus I(i/) = K(v ® v) - I . 

Another form of the cited inequality is that for any two probability measures 
v\ , v 2 we have 

(6) 2K(i^i ® v 2 ) > K{vx <g> ^i) + K(^ 2 ® ^2)- 

In particular, 2k(x,y) > k{x,x) + k(y,y), which implies that Jo = inf^^ fc(a:, y) = 
inf x fc(x,x). □ 

Remark 1. Inequality 0) implies that the rate function satisfies 

2. Applications 
2.1. Let g(x,y) = e -* 2 -y 2 +20«/. Then 

n n n 

/(x, y) = exp(~n ^ xf - 7i ^ y| + 29 ^ x iyj ) 

i=l j=l i,j=l 

and k(x, y) = x 2 + y 2 — 29xy. 

Denote by m r (y) — J x r v(dx) the r-th moment of a measure v. 

Proposition 1. (i) If \6\ < 1 then the empirical measures 

1 - 

V n := ~/S Xi 
n — ' J 
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satisfy the large deviation principle in the scale n 2 with the rate function 
I(u) = (m 2 {v) - 6 2 m\{v)) . 
(ii) If < 9 < 1 then the average empirical measures 

1 - 

&n := 2n22^ Sx ' +5 v^- 

i=l 

satisfy the large deviation principle in the scale n 2 with the rate function 
I(v) = 2{m2{v)-dm\{v)) . 
(In the formulas above, use 1(f) = oo if m^iy) - co.) 
Remark 2. The marginal density relevant in Proposition^(i) is 

f 1 ( X ) = C(n ) e)e X p[-n 2 \±J2 x i- 



ii 




i=l 

Remark 3. Both rate functions in Proposition^ are concave. 

Proof, (i) It is easy to see that the assumptions of Theoremnare satisfied. Indeed, 
k{x,y) = (x — 9y) 2 + (1 — 2 )y 2 is continuous, bounded from below. Furthermore 

{k(x, y) < a 2 } C {|y| < \a\/(l 9 2 )} n {\x\ < \a\/(l ~ 9 2 )} 

so k(x, y) has compact level sets. Finally, for a > by a change of variables we see 
that j'J e~ ak( - x ' v ^dxdy = ^ // e~ k( - x ' y )dxdy < oo so Assumption is satisfied, too. 

The result follows by the contraction principle: taking a marginal of a mea- 
sure in V(M. 2 ) is a continuous mapping. The rate function is inf{I(/i) : v(A) = 
fi(A x K)}. But since I is infinite on non-product measures, this is the same 
as infi/ 2 {Jj k(x, y)v(dx)v2(dy) — Iq}. Since Iq — here, it remains to notice 
that m{ U2 {JJ k{x,y)v(dx)v 2 (dy)} = inf. y {J k(x, y)v{dx)} = mf y {m 2 (f) + y 2 - 
29ymi{v)} — m 2 (f) — 9 2 m\{v). 

(ii) This follows from Corollary if 6 > then 29xy is positive-definite. Thus 
k(x, y) = x 2 + y 2 — 29xy is a negative definite kernel. □ 

2.2. Next, we consider a model which can be interpreted as a "decoupled" version 
of a model studied in relation to eigenvalue fluctuations of random matrices, where 
one encounters xj instead of our yj , compare [Ref. Q Section 5] , [Ref. formula 
(1.9)]. We consider here a slightly more general situation when 

g(x,y) = \x-yfe- v ^- w ^. 

Then 

n n n 

/(x,y)= [] \^~y 3 fl[e'^l[e'^\ 

i,j=l i=l j=l 

and k(x, y) = V(x) + W(y) — /31og \x — y\. We assume that functions V(x), W{y) 
are continuous, j3 > 0, and that 

(7) hm YM = lim w (\y\) _ „ 



|a;|->oo log Vl + X 2 |j/|->oo log + y 2 
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Proposition 2. The bivariate empirical measures fi n defined by 0) satisfy the 
large deviation principle in the scale n 2 with the rate function I given by 
In particular, ifV(u) = W(u) = u 2 , then the rate function is 

<8 i/ 2 ) = m 2 (i/i) + m 2 {v 2 ) -0 J I \og\x - y\ Vl {dx)v 2 {dy) + 1/2 0Qog0-l). 

Proof. We verify that the hypotheses of Theorem ^ are satisfied. Assumption 2] 
holds trivially. Assumption [3] holds trivially since V(x) + W(y) is continuous. 
To verify Assumption notice that 

(8) k(x, y) >V(x)+W(y)-0 log y/l + x 2 - log ^l + y 2 . 

Since V(x) — log v 1 + x 2 is a continuous function which by JJJ tends to infinity 
as x — ► ±oo, it is bounded from below, V(x) — /3 log vl + x 2 > — c for some c. 
Similarly, — log \/l + y 2 > — c. 

We now verify Assumption 0] The set K a := {k(x,y) < a} is closed since k 
is lower semicontinuous. Furthermore, (JHl implies that K a is contained in a level 
set of the continuous function V(x) + W(y) — log Vl + x 2 — 0log \J\ + y 2 . The 
latter set is bounded since V(x) — log V 1 + x 2 > a + c for all large enough \x\ and 
similarly W(y) — 0log a/1 + y 2 > a + c for all large enough \y\. 

To verify Assumption [2] we use inequality (JSJ again. It implies 

g(x,y) a dxdy < J e -<*(V( x )-pu, s VT+^) dx J e -a(w(„)-/Jlog V^) dy , 

By assumption J7J), there is N > such that for |x| > iV we have 
V(x) > (0 + 2/a) log vT+x 2 . By the previous argument the integrand 
is bounded; thus f e ~«(V(*)-Pio g VW^) dx < e -a(V(x)-0lo S VT+^) dx + 

Therefore, by Theorem ^ the empirical measures (x n satisfy the large devia- 
tion principle with the rate function I{v\ ® u 2 ) = J V{x)u\{dx) + J W(y)v 2 (dy) — 
JJ log \x — y\vi{dx)v 2 {dy) — I . If W(u) = V(u) = u 2 then 7 = mf x/y {x 2 + y 2 - 
0log\x - y\} = 0/2(1 - log/3) by calculus. □ 



3. Auxiliary results and proof of Theorem ^ 

The proof relies on Varadhan's functional method, see [Ref. [3J Theorem T.1.3], 
[Ref. Theorem 4.4.10]. It consists of two steps: verification that the Varadhan 
functional 

$ i — ► IL( < I > ) := lim log Eexp ($(An)) 

n — >oo 77, 

is well defined for a large enough class of bounded continuous functions $ : V — ► R, 
and the proof of exponential tightness of {fi n }- 

3.1. Varadhan functional. Let Fx,... F m : R 2 — > R be bounded continuous func- 
tions. Consider the bounded continuous function $ : T-^R 2 ) — > R given by 

(9) := min / 

1 < r < m J 

We will show the following. 



6 



WLODZIMIERZ BRYC 



Theorem 2. Under the assumptions of Theorem^ 

(10) lim \ log / exp(7i 2 $(A„))/(x,y)dxdy 

n—>oo n J 

= sup <^ - / k(x, y)dfj, : /x = v x ® z/2 G 7>(R 2 ) 



Denote K(/i) = J" k(x,y)d\i. Notice that by Assumption|2|we have — K(/i) < 
max r 1 1 .F r | |oo + C. In particular, 

(11) sup{$(^) -K(/x) : a* G P(R 2 )} < co. 

We prove p(J|) as two separate inequalities. It will be convenient to prove the 
upper bound for a larger class of functions 

Lemma 1. If Assumptions^ and\^ hold true, then for every bounded continuous 
function $ : :P(R 2 ) — > K we /lave 

(12) limsup-^log / exp(n 2 $(// n ))/( x ; y)rf x dy 

71 — !-OG W J 

< sup {$(a«) - K(/x) : a« = fi <8> f 2 G 7>(R 2 )} . 
Proo/. Notice that for < 9 < 1 



exp(n 2 $(/i„))/(x, y)dxdy 

« n 

= / exp(n 2 ($(A„) - 9K(fi n )) -(1-6)^ k{x t , yj ))d^dy 
< exp I n 2 sup ($(fi ® 1/2) - flK^i ® v 2 )) ) / exp(-(l - 6) k(xi,yj))dx.dy. 



Since 

n n 

X] H x i,Vj) > -n 2 C + ^2k(xj,yj), 

«ij=l 3=1 

therefore 

^2 log y exp(7i 2 $(/i n ))/(x,y)dxdy 



< sup{$(^i <g> i/ 2 ) - 0if (z^ (g) iaj)} + (1 - 0)C + - log Mi_ 



Thus 



limsupilog / exp(n 2 $(/t„))/(x,y)dxdy 
< sup {0($(i/i ® i/ 2 ) - <8> ^2)) + (1 - ® f 2 )} + 2(1 - 0)C 

< 9 sup{$(^ ® ^ 2 ) - *S>i <8 v 2 )} + (1 - 0)||$||oo + 2(1 - 9)C. 
Passing to the limit as 9 — > 1 we get (11211 . □ 

The proof of the lower bound is a combination of the discretization argument 
in [Ref. 1 pages 532-535] with the entropy estimate from [Ref. % pages 191-192]. 

Denote by Vo the set of absolutely continuous probability measures v(dx) = 
f(x)dx on R with compact support supp [y), and continuous density /. Let us first 
record the well-known fact. 
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Lemma 2. If v € Vq then v has finite entropy 

Hf :— J \ogf(x)v{dx) < oo. 

We first establish a weaker version of the lower bound. 
Lemma 3. If & is given by 0), then 

(13) liminf^log / exp(n 2 $(/t„))/(x, y)dxdy 
> sup{$(z/i <g> v 2 ) - K(i/i <8> t^) : ^2 € Po}- 

Proof. Fix i/j, 1/2 6 "Po- Since k(x,y) > — C is bounded from below, K(Vi ® 7/2) G 
(—00,00], so without loss of generality we may assume that k[x,y) is v\ ® v%- 
integrable. 

Since measures v\, v-i are absolutely continuous and have compact supports, for 
every integer n > we can find partitions 111(77,) = {ao < ffli < • ■ • < a„} and 
Il2(n) = {bo < bi < ■ ■ ■ < b n } of supp (vx), supp (1/2) respectively such that 

vi(ai-i,ai) = V2(bj-i,bj) = - for i,j = 1,2, . . . ,n. 

Then, denoting A = [ao, a{\ x [a\, aa] x • • • x [a n _i, a n ] and B = [60, 61] x [61, 62] x 
• • ■ x [6„_i, 6 n ], we have 

(14) Jexp(n 2 $(/j„))/(x,y)dxdy 

^ Iaxb ex P ( min *- E"j=i F r{xi,Vj) - E"j=i H^,yj)) dxdy . 
Write 1/1 = f(x)dx, V2 — g(y)dy. By our choice of the partitions, functions 

/i(x) := nf(x)I [a ._ uai] 

and 

0j(aO := ng(x)I [bj _ ubs ] 

are probability densities. Let 

n n n n 

S(x,y) =min ^ F r { Xi , yj ) - ^ Vj) ~ ^2^gf{xi) - ^loggfa). 

j,i=i «,i=i »=i j=i 

Integrating over a smaller set {/i(a;i) > 0, . . . , /„(a;„) > 0, 31(2/1) > 0, . . . , 3„(y„) > 
0} on the right hand side of (|14H we get 

exp(n 2 $(/i n ))/(x, y)dxdy 



> 

71 



— / exp^^y))]^/^ JJ 5j ( % )dxdy. 

** A 1 A 1 



3=1 

Using Jensen's inequality, applied to the convex exponential function in the last 
integral, we get 

J exp(n 2 <P(fi n ))f(x,y)dxdy > exp(5i -S2-S3- S4), 
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where 



/ n \ n n 

Si = \ min ^2 F r(xi,yj) JJ fi(xi) JJ gj(xj)dxdy, 

jR2n \ r i,J = l ) i=l 0=1 

„ n n n 

Si = I ^2 k{x i ,y j )~[[fi(xi)~[[g j {y j )dx.dy, 

„ n n 

s 3 = / viog/^n^)^* 

^™ »=i i=i 

„ n n 

Si = i y2 l °S9(yj) T\9j(yj)dy- 



We need the following identities. (Proofs of all Claims are postponed until the 
end of this proof.) 

Claim 1. For a v\ ® V2-integrable function h, we have 



~ n n 

\ Y) h (Vj) TT djiv^dy = n h(y)g(y)dy, 
Jr* j=1 j=1 Jr 

~ n n „ 

/ V" h(xi) TT fi(xi)dx = n / h(x)f(x)dx, 
Jn. n • i Jr 



i=l i=l 



h ( x i>yj) II f*( Xi ) II 9j(yj)dxdy 

i,j = l i=l j=l 



= n J J h(x,y)f{x)g(y)dxdy. 

Lemma [21 says that the entropies Hf = J log f(x)f(x)dx, H g = J log g(y)g(y)dy 
are finite. Thus the functions k(x,y), log f(x), and logg(y) are v\ ® i/2-integrable. 
Applying ClaimQ] we get 52 = n 2 IK(;/i ® u 2 ), S3 = nHf, and S4 = nH g . Therefore, 

(15) Jexp(n 2 $(/t„))/(x,y)dxdy 

> ^ exp(Si - n 2 K{vi ® v 2 ) - nH f - nH g ) . 

We need the following lower bound for Si . 
Claim 2. 

(16) J ^min Y2 F r (xi,yj)j Y[Mx l )Y[g j {y j )dxdy 

n 

>min J2 F r,(i,i)> 

where 

F r ^j) = min{F r (a;, y) : a,_i < x < a,, < y < b. } } . 
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Combining inequalities lfT5|l and ljTH|l. we get 

(17) ilog J exp(n 2 $(A„))/(x,y)dxdy 

1 " 112 
> — min 2J Fr,(i,j) ~ ^(^i ® ^2) #g logn. 



Since functions F r (x, y) are continuous and u\, v- 2 have compact support and con- 
tinuous densities /, g, therefore z/i<g>z/ 2 -almost surely Yli,j=i F r,{i^) I {a^ 1 ,a,){x)I{ b] _ l ^ j )(y) 
F r (x,y) (to see this, notice that for fixed e > 0, the sequence convergences for 
all (x,y) such that f(x) > s,g(y) > £.), and the functions are bounded. Since 
1 < r < m ranges over a finite set of values only we have 



1 " 
lim — 5- min N F r (j »• 



= min lim F r (i ^^(aj-i, aAu^ibj-ibj) = g> f 2 ). 

r n— *oc * — • v 7 

Letting n — > 00 in (|17|l we obtain (|13fl • 

To conclude the proof, it remains to prove Claims ^ an d HI 
Proof of Claim ^ Switching the order of integration and summation, we get 

n n „ 

^2 h (yj)Y[9j(yj)dy = ^2 / h (yj)9j(yj)dyjYi / 9t{yi)dyt 

3=1 J = 1 i^j 

= ^Z h (yj)9j{yj)dyj =n^2 / h(y)g(y)dy = n / h(y)g{y)dy. 

j=l J j = l Jbj-i Jb 

The other two identities follow by a similar argument. □ 
Proof of Claim |5J Fix < k < n, x\ , . . . , Xk € R and y\ , . . . , y n £ R. Let 



n n 



G rt k(xi, . . . ,x k ) := V y^F r (x i: yj) + V V min F r (x, yj ). 

2—1 J — 1 2— fc + 1 J = l 

If cik-i < Xk < &ki w e have 

minGWzi, . . . ,x k ) = 

r 

' k— 1 n 

min F r(xi,yj) + Y] F r (x k , Vj ) + V V min F r (ac, 

^ 1 ^ — * * — ' ^ — ' ^ — ' * — ' ai-\<x<<ii 
i=l j j i=k+l j 



Therefore, 



Recurrently, 



> minG rifc _i(a;i, . . .,x k -i). 

r 

ra-k 

/ min Gr tk {~x)fk{xk)dx k > minG^fc-^x). 
j min \^2^2F r { 

%i 1 yj 
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min G r] n(x) I I fi(xi)dx > minG r o(x) 

n n 
* — ^ ^ — * ai_i<a;<ai 

Applying the same reasoning to variables 2/1, . . . , y n and 

k n n n 

G r ,k(yi, ■ ■ ■ , Vk) ■= V V min F r (x, yj) + V V F (l - } 

^ — ' * — ' ai-\<x<ai c — ' * — ' 
j = l i=l j=k+l i=l 

we get (JTHJl. □ 

This concludes the proof. □ 

The next Lemmas show that the right hand sides of i|12|) and i|13|l coincide. 
Let V c denote compactly supported probability measures. 

Lemma 4. If Assumption^ holds true, then 

(18) sup{$(i^i ® v 2 ) - K(z/i ® i/ 2 ) : vi, v-i S 7> c } 
= sup{<I>(^i <g j/ 2 ) — K(Vi <g j/ 2 ) i^i^e T 5 }. 

Proof. Clearly the left-hand side of (|18J) cannot exceed the right hand side. To 
show the converse inequality, fix r\ > and V\ , v 2 £ V such that 

(19) $(z/i (g> z/ 2 ) - (g) z/ 2 ) > sup {$(^i <g i/ 2 ) - K(i/i <g i/ 2 )} - ??■ 

Since the supremum is finite, see and &(x, ?/) is bounded from below, therefore 
JJ \k{x , y)\dv\dv 2 < 00. 

For L > large enough, define probability measures Vjjj by 

"'^ - ,([-£,1]) ''- 1 ' 2 - 
By definition, measures ^j.L € 7^ have compact support. Since —C < 
fc(x, y)/|a;|<L,|i;|<L < ^(^jZ/)! an d A; is ^1 (g ^ 2 -integrable, by Lebesgue's dominated 
convergence theorem 

lim^^oo f L r f L r k{x,y)ui(dx)v 2 (dy) 

lim K(ui l ® = , A Vn /n = K ^ 

Similarly, 

lim $(z/i !L <S> ^ 2 ,l) = *(^i ® ^2)- 
Thus (HH follows. □ 
Lemma 5. // Assumptions^ and\^ hold true, then 

(20) sup{$(i/i (g i/ 2 ) - K(i/i (g i/ 2 ) : i/i, ^ 2 € "Po} 
= sup{$(^i (g v 2 ) — K(vi (g ^2) : v\, v 2 £ V}. 

Proof. Trivially, 

sup {$(1^1 (g v 2 ) - K(^i (g t/ 2 )} < sup {§(vi (g ^ 2 ) - K(fi (g ^ 2 )}- 
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To show the converse inequality, fix rj > and compactly supported V\,v 2 € V c 
such that 

(21) <J>(^i ® v 2 ) - K(^i ® v 2 ) > sup {$(^i <8> v 2 ) - K(fi <g> ^ 2 )} - V, 

see Lemma0J As previously, k(x,y) is z^i <8> z^-integrable, see (ITTTl . 

Consider the convolution Vj(A) := ^ £ — a;)<iizi, where j = 1, 2 and < 
e < 1. Measures v\ 1 v 2 have continuous densities, and since ^1,^2 have compact 
supports, i^f , J'f also have compact support. Thus j/| G 7-o an d 

(22) sup {$(1/1 <g> iaj) - Myx <g> i/ 2 )} > $(14 <g> z/f) - K(i/f <g> i/f). 

As e — > measure converges weakly to Vj . Hence 

(23) Mm<$>{vi ®v I) = ®{vx®v 2 ) ■ 

Assumption |3] asserts that V(x, y) :— [3 log \x — y\ + k(x, y) is a continuous func- 
tion. Thus is bounded on the compact set supp (y\ ® v\). Since the 
supports of uf ® v 2 are contained in supp [y\ ® v\\ and f| — * Uj, we get 

(24) J I V{x,y)ul(dx)ul{dy) JJ V(x,y) Vl (dx)v 2 (dy). 

This concludes the proof if j3 = 0. If /3 > 0, then log \x — y\ is v\ ® i^-integrable 
as a linear combination of integrable functions, log \x — y\ = (V(x, y) — k(x, y))/ (3. 
Therefore we have 

<J>(i/f ® - K(i/f ® vf) = $(^1 ® ff ) 
V{x,y)vl{dx)vl{dy) + 13 11 log |x - y\ui(dx)u 2 (dy) 



-P yjj log \x - y\vi(dx)v 2 (dy) - J J log\x - y\vl(dx)v e 2 {dy) 
Taking the lim sup as e — > 0, from (J23l, (H3}, and we get 

sup {$»(Vl <8 1^2) - ® ^2)} > sup {$(^1 <g) ^2) — K(i y i ® ^2)} - ?? 

- lim sup (^JJ log \x- y\v 1 {dx)v 2 {dy) - J J \og\x - y\vf(dx)v 2 (dy) 

Since 77 > is arbitrary, to end the proof we use the following. 
Claim 3. 

lim sup (J J log 1 1 - y\v 1 (dx)v 2 {dy) - J J log |x - y\v{{dx)vl{dy) \ < 0. 



□ 



Proof of Claim [3| Claim [3] is established by the argument in [Ref. 9, pages 
192-193]. For completeness, we repeat it here. Let X, Y be independent random 
variables with distributions 1^1,1^2 respectively and let Z = X — Y . Since log|Z| 
is integrable, Pr(Z = 0) = 0. Let U £ [—2, 2] be a r. v. independent of Z with 



12 



WLODZIMIERZ BRYC 



the density f(u) = (2 — |u|)/4. It is easy to see that Jj \og\x — y\vf(dx)v2(dy) 
E\og \ Z + eU\, and the inequality to prove reads 



limsupE [ log+ 1 ) <0. 



For fixed z^Owe have 



<25 » B ( l0g+ uT^) S ^ l0g ( 1 + S 

Indeed, since (2 — |u|)/4 < 1/2 we get 



Therefore, 



M^logi^ + jf^-Mog+i^) ifN<2 £ 



If |z| > 2e we get E (log+ — ^_ J < ± log < \ log(l + j|) < ^ log(l 

f ). If |z| < 2s, then £ (log+ — L^) < ^ £ log < 1 < ^ log(l + f 
Thus in both cases, (|25(l holds true. 



To finish the proof we integrate inequality l|25(l and get 



1 \ < J_ 

_ |i + E §|J - log2 ™o J 



limsupff (log+ - ^ ) < — -limsup£(log(l + 2 E /|Z|)). 



For e < 1/2 we have log(l + 2e/\Z\) < log 2 + log + and log + rL- is integrable. 
Lebesgue's dominated convergence theorem yields 



limsup£(log(l + 2e/\Z\)) = 0. 



□ 



Proof of Theorem [2J Combining Lemmas ^ and we have 
sup{$(^i (g> zaj) - K(z/i ® i/ 2 ) : ^i, ^2 S T'o} 

< liminf-2 log / exp(n 2 $(//„))/(x, y)dxdy 

< limsup-j log /exp(n 2 $(/i„))/(x,y)dxdy 

n — >oo H J 

< sup{$(y 1 ® z^ 2 ) — ® i/ 2 ) : Vi,i/ 2 G T 3 }. 

By <|20ll . all of the above inequalities are in fact equalities. Thus (|10|) holds true. □ 
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3.2. Exponential tightness. Recall that {/t n } is exponentially tight if for every 
m > there is a compact subset K. C V such that 

sup 4r logPr(/2 n ^ K) < -m. 

n n z 

Our proof of exponential tightness is a concrete implementation of de Acosta.^ 
Assumption |21 implies that k(x, y) + C > 0. Let q : V(R 2 ) — > [0, oo] be given by 

= / (K^y) + c)cfyi. 

Lemma 6. J/ Assumptions^ ^] ftoZrf irue, iften q has pre-compact level sets: for 
every t > 0, <7 — 1 [0, t] is a pre-compact set in V . 

Proof. Fix t > and denote JC := {/i G 7>(K 2 ) : g(^) < i}. We will show that /C is 
pre-compact. 

Assumption 0] says that for every e > the set i4T e := {(x,y) : C + k(x, y) < t/e} 
is a compact subset of R 2 . For every [i 6 JC by Chebyshev's inequality we have 

mC^s) < /*({(*, y) = C + fc(x, y) > </e}) < ^ = e. 

Thus /C is pre-compact, and its weak closure JC is compact. □ 

Lemma 7. // Assumptions QJ and\^hold true, then 
1 f 1 

(26) sup — log / exp(-n 2 g(/}„))/(x,y)dxdy < oo. 

n ri J 1 

Proof. We have 

/ exp(-n 2 q(fi n ))f(x,y)dxdy = / exp(-n 2 C - - k(xi,y 3 ))dxdy 

< e ^ 2 c /" ^~y~)dxdy < e n2c M? /2 . 

Therefore the left-hand side of l|26|l is at most C + log + Mxi% < oo. □ 

Theorem 3. Under the assumptions of Theorem^ the sequence {fj, n } is exponen- 
tially tight. 

Proof. Notice that by l|l(J|l used with $(/Lt) := we have ^j\ogZ n — > L : = 
— inf M J" /c(x, y)d/j. = — inf^y k{x, y). Since Lq is finite, see Ijlljl . therefore by Lemma 
0we have 

I f I 1 

sup — log / exp(-n 2 q(ft n )) — f(x,y)dxdy = d < oo. 

n /I J ^ 

Fix m > 0. Let JC C "P be the pre-compact set from Lemma corresponding to 
t = 2to + 2Ci. 

Applying Chebyshev's inequality to probability measure 10 we get 

t« 2 t f ,1 



Pr(A„ < Pr(A„ = Pr(g(£ n ) > *) < e~ 2 ™ 1 / exp(-n^(/i„))dPr . 



Therefore 

Pr(/t„ g£) < e-« n_t e 



in 2 * n 2 Ci 
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and 

-5 logPr(A„ <£ K) < -t/2 + Ci = -m 
for all n. □ 

Proof of Theorem ^ Recall that the space V = ^(M 2 ) of probability measures 
on R 2 with the topology of weak convergence is a Polish space. By Theorem |3| 
{fin} is exponentially tight. Theorem says that the Varadhan functional 

L($) := lim \ log E (expn 2 $(/t n )) 

n— >oo n 

is defined on all functions <& given by (JHJ), and 

L($) = sup{$(^i ® v 2 ) - K(z/i ® f 2 )} - lim \\ogZ n 

1/1,1/2 n^oo n -2 

= sup {$(1/1 ® 1/2) - K(i/i <g> !/ 2 )} + inf k(x,y). 
1/1,1/2 

Thus 

(27) L($) = sup{$(i/ 1 ®i/ 2 )-K(i/ 1 (gii/ 2 )} + 7Q. 

I/l ,1/2 

Functions $ defined by form a subset of Cb('P(M 2 )) which separates points 
of T-^R 2 ) and is closed under the operation of taking pointwise minima. Thus 
by [Ref. Theorem T.1.3] or [Ref. 6, Theorem 4.4.10], the empirical measures 
{fi n } satisfy the large deviation principle with the rate function 

(28) I(p) := sup{$(/i) - L(4>)}; 

here, the supremum is taken over all F\, . . . , F m € C(,(R 2 ) and $(/i) is defined by 
©• 

It remains to prove formula Q . Fix v\ , v% S . From (|27|l , for $ given by © 
we have L($) > $(z/i ® ^ 2 ) - K(^i ® k 2 ) + Io- Thus formula implies that 

(29) I(z/i ® z/ 2 ) < K(^i ® 1*2) - 7 . 

To prove the converse inequality we use the fact that we already know that the 
large deviations principle holds. The large deviations principle implies that 

(30) l{v x <g> v 2 ) = sup {$(1/1 <8> f 2 ) - L($)}. 

*ec b (-p) 

Now consider $m(m) = /(^ A k(x,y)) dfi. Assumptions [21 and |S] imply that 
(x, y) 1— > M A fc(x, y) is a bounded continuous function for every real M. Thus $m 
is given by Since M A fe(a;, y) < k(x, y), from J^ZJ we g et L($ M ) < Zq. Thus 



I(^i ® ^2) > sup{$ M (^i ® f 2 ) - L($m)} > limsup I MA k(x,y)dfi - I . 

M Af->oo J 

This together with (|29|l proves Q for product measures. 

It remains to verify that if /iq is not a product measure, then l(jMy) = 00. To 
this end, take bounded continuous functions F(x),G(y) such that 



S := J F(x)G(y)n (dx,dy) - / F(x)(i (dx,dy) / G(y)fj, (dx,dy) > 0. 
For b > 0, let 

$ b (/i) :=&( / F{x)G{y)ix(dx,dy)- I F(x)^(dx,dy) I G(y)fi(dx,dy) 



LARGE DEVIATIONS UNDER SYMMETRIC INTERACTIONS 



15 



Clearly, $h : V — > R is a bounded continuous function, which vanishes on product 
measures. By the upper bound (|12|l we therefore have L($t) < In. So I(/io) > 
^(Mo) ~ >bS— Iq. Since 6 can be arbitrarily large, I(^o) = oo. □ 

Acknowledgements. I would like to thank P. Dupuis for a conversation on non- 
convex rate functions. 
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